Distributed Reinforcement Learning for Age of Information Minimization in Real-Time IoT Systems
نویسندگان
چکیده
In this paper, the problem of minimizing weighted sum age information (AoI) and total energy consumption Internet Things (IoT) devices is studied. considered model, each IoT device monitors a physical process that follows nonlinear dynamics. As dynamics vary over time, should find an optimal sampling frequency to sample real-time system send sampled base station (BS). Due limited wireless resources, BS can only select subset transmit their information. Thus, edge cooperatively monitored based on local observations will collect from immediately, hence avoiding additional time used for transmission. To end, it necessary jointly optimize policy selection scheme so as accurately monitor using minimum energy. This formulated optimization whose goal minimize AoI cost consumption. solve problem, we propose novel distributed reinforcement learning (RL) approach optimization. The proposed algorithm enables global own observations. Given policy, be optimized thus all devices. Simulations with real PM 2.5 pollution data show reduce by up 17.8% 33.9%, respectively, 13.2% 35.1%, compared conventional deep Q network method uniform policy.
منابع مشابه
Real-Time Interactive Reinforcement Learning for Robots
It is our goal to understand the role real-time human interaction can play in machine learning algorithms for robots. In this paper we present Interactive Reinforcement Learning (IRL) as a plausible approach for training human-centric assistive robots by natural interaction. We describe an experimental platform to study IRL, pose questions arising from IRL, and discuss initial observations obta...
متن کاملReinforcement Learning In Real-Time Strategy Games
We consider the problem of effective and automated decisionmaking in modern real-time strategy (RTS) games through the use of reinforcement learning techniques. RTS games constitute environments with large, high-dimensional and continuous state and action spaces with temporally-extended actions. To operate under such environments we propose Exlos, a stable, model-based MonteCarlo method. Contra...
متن کاملComplexity Analysis of Real-Time Reinforcement Learning
Real-Time Reinforcement Learning Sven Koenig and Reid G. Simmons School of Computer Science Carnegie Mellon University Pittsburgh, PA 15213-3891 [email protected], [email protected] Abstract This paper analyzes the complexity of on-line reinforcement learning algorithms, namely asynchronous realtime versions of Q-learning and value-iteration, applied to the problem of reaching a goal state in d...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Journal of Selected Topics in Signal Processing
سال: 2022
ISSN: ['1941-0484', '1932-4553']
DOI: https://doi.org/10.1109/jstsp.2022.3144874